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SECTION 1.0 

ivtR'Tiv-ion 

1 . 1 BACKGROUND 

The Robertson model for predicting the rate at which wheat 
progresses through its ontogenetic life sycle was selected 
for preliminary use in LAOIS ,refa. 1 and This model 

livides the life cycle into six stages and uses a separate 
phene logical equation for each of the five intervals be’veen 
the stages. An additional "equation" is being selected to 
estimate when the planting stage begins (starter -no del ) . 
Tally -.laocimum and minimum temperature and lay length are the 
inputs for the Robertson equa'lons, and the starter model 
has the additional requirement -f daily preeipltat ion . 

The Robertson model was teat implemented for crop districts 
in eight Great Plains stages during LAOIS Phase I by t he 
Yield estimation Subsystem, "he accuraoy of the 10" f . pre- 
dictions was evaluated by plotting the '.'I'TA :'R:? reported 
data on the same charts. Sxanples of these comparisons are 
given in appendix A. As anticipated, there were some 
discrepancies apparent because of differences in stage 
definitions and wheat cuit-ure from region to region.” 


i 

The Robertson equations were developed from experimental data 


in Canada. 


In order to meaningfully assess the bias and variance of the 
crop stage predictions and obtain measurements that can be 
used to correct bias and provide confidence intervals, it 
is necessary to carry out a mere comprehensive test analysis. 
Basically, this involves obtaining field observations and 
model predictions for a larger sample of repeated years and 
areas to statistically determine the two components of the 
errors . 

OBJECTIVES 

The primary objective of the test plan is to determine the 
bias and variance in the stage dates predicted by the 
Robertson and starter models as compared to the I'SDA SRS 
field observed dates. 

A second objective is to evaluate both error components in 
the observed-predicted departures with respect to differences 
between years and crop districts This is to determine if 
the departures have causes other than random effects. 



SECTION 2.0 


TEST SSSORIFTIJS 


APPROACH 

The difference between the observed dates when 50 percent 
of the wheat fields in a CRT reach a stage and the predicted 
date of occurrence is the response variable of interest for 
analysis. The crop state, district, and year are factors 
which can be used to classify the departures and detc-nine i 
there are significant differences among their corresponding 
deans . 

The mean departure, after the variation associated with all 
of the above factors is removed, represents the net remain- 
ing bias. This bias could be due to errors in the model 
or differences in the definitions of the stages. The vari- 
ance in the departures could be due to environmental effects 
not in the model, observer errors, etc. 

A three-way classif ication A.'ICVA will be used to determine 
the effects cf stages, districts, and years or. departures 
between observed crop calendar dates and predictions. The 
effects of each factor are considered fixed rather than 
random. Duncan's multiple range test wil . be used to com- 
pare specific means of interest. 
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DATA REQUIREMENTS 


All predicted stage dates other than those for 197* must 
be generated by operating the crop calendar model with the 
appropriate weather data. The required weather data are 
the tally maximum and minimum temperatures and precipita- 
tion averaged for each CRD to be used for teat in*. 

The CRD’s for use in this inaiysis were selected to represent 
both spring and winter wheat areas, and they have available 
more than one year of historical data. The JRS data is 
given in the following table, and predicted values will be 
made for the same districts upon receipt of the weather data. 


Crop reporting district 

Historical 

1975 

Texas: 1 ,2 , 3 ,!* ,5 ,3,11 

19t>l* to 1971* 

Requested 

Kansas: all (9' 

a 10S2 to 1971* 

Received 

Colorado: 10, 20, e0, 70, 90 

a 197i to 197i* 

— 

North Dakota: all (9) 

b 10 el* to 197U 

Requested 

Montana: 10,20,30 

b 1961* to 197!* 

Requested 

Oklahoma: 1 through 3 

a l9tv* to 197!* 

Received 


a Tata currently in ICRRS. 

'Requests for data made to DAFT.' lUPDA' Keb. lS , 197*; 
but delivery date is uncertain. 
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2.3 


TEST DESIGN 


The acdel and corresponding ANCVA table for analysing the 
variance of the near, departures in this case can be written 

as 


where Z, * observed date - predicted c*ate for the ith 
stage in the Jth district and kth year 
u * aean 

S, * effect of the ith stage, i ■ 1,2,..., s 
D, » effect of the Jth district, J * 1,2,..., d 
Y^ * effect of the kth year, k * l,2,...,y 
(3D)., * interaction of stages with districts 
(SY',^ * interaction of stages with years 
(DY),. ■ interaction of districts with years 
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ASSUMPTIONS 


The second order interaction, 3 » ? » Y is assumed tv' be 
lero and its mean square is used as an estimate of error. 
The additivity of components, homogeneity of variance, 
independence of errors, and normality of errors are assumed 
to be fulfilled for the ANOVA . These assumptions are ex- 
amined by the techniques given in appendix P. 


; '.T A r I I OAL IN F PS KN v’ ES 

The following hypotheses are tested using Snedecor's F-test 
with an o level of 10 percent. 


1) 

2 ) 



u ■ 0 H : u * 0 

a 

u n " U T5 ■ ••• ■ U D 

P 1 2 d 


3) H, 

o 


H : otherwise 

a 


U *11 

Y Y 

l i : 


H : otherwise 

a 


1*' H. 


• u Q • . . 

3, 




II : otherwise 

a 


(general test for bias^ 
^test for differences 
between districts' 

(teat for differences 
between years' 

(teat for differences 
between stages' 


The oo percent confidence interval for predicted occurrence 
dotes for a stage will be obtained from the relation 


t (O.OSn 


1 ) 




♦ t 


(0.0S n 



0.00 





where 


Y. , ■ late predicted by the model for the ith stage 
for the Jth area 


2.6 


Y. . » true late the %tage occurred 

t ■ tabled value of student's -t statistic 
s^ » the standard error for model predictions 


« ; I V' - 2 
j N La “ij 


(»z=,.y 


yh,r * : ij ' hi ' hi 


Using the departures for computing the variance of the pre- 
dictions assumes only that the actual dates are measured 
without error. The areas for which this variance is pooled 
will depend upon the outcome of the ANOVA and homogeneity 
of various test3. 


EXPERIMENTAL STEPS 

The first step i3 to assemble the historical weather for 
the required districts. In some cases this needs to be 
tabulated from the climatological records. Given the 
weather input data, the model will be operated on the JSC/ 
UNIVAC 1110. 

The sums of squares, mean squares , and test statistics for 
the ANOVA can be calculated using JSC 3MD library software. 
The tests for homogeneity of variance car. be performed using 
a desk calculator. 
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Mean errors between stages will be compared with Duncan's 
multiple range test. Within each stage of the crop calendar, 
errors will be examined by location and years to evaluate 
possible causal factors. 

2.7 OUTPUT PRODUCTS 

Tables of the mean, observed-predicted departure for each 
stage, year, and district and overall stages, years, and 
districts will be prepared. Departures which are statisti- 
cally significant will be indicated. The standard errors 
associated with tha^e means will be given. 

An analysis of significant departures will be prepared by 
plotting and evaluating differences between locations and 
years in relation to causal factors. 


i V ^ 

tfSS’Sk** 
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SECTION 3.0 


implementation 


3.1 MAJOR TASKS 

The aa^or functional task* are summarized as follows. 

A. From NCAA station records (tapes requested from CCEA) 
calculate the daily weather parameters for the crop 
reporting districts listed in section 2.0. 

3. Exercise the Robertson and starter models to obtain the 
predicted dates for each stage. 

C. Carry out the analysis of variance and testing. 

D. Summarize the results and write a final report. 

3.2 RESOURCES 

Tasks A, 3, and C primarily involve computer processing of 
the corresponding data. Preparation of the meteorological 
data will also require some new programming. Approximately 
6 aanveek 3 of effort are required for these tasks. 

The Robertson model has been programed for test operation 
at JSC, and software for the AIIOVA (task C) i3 also avail- 
able. Thus, with the weather tapes provided, task3 B, C, 
and D can be completed at JSC. The total personnel re- 
quirement is estimated to be lU manweeks, and CP'' :ontuter 
tine should not exceed 1 hour. 
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3.3 


SCHE'L'LE 


The schedule for the crop calendar :est and evaluation plan 

is given in figure 3-1. 


3-2 




3-3 










SECTION 1*.0 


REFERENCES 

1. Stuff, R. 0.: Preliminary Evaluation of Fhenological Models for 

Spring Wheat. Technical Memorandum, LEC-613 1 -. Lockheed Electronics 
Company (Houston, Tx.), 1975. 

2. Wilcox, D. D.; Champagne, 0.; 3a3kett, R.; and Woo ley, S.: i 

Fortran Implementation of the Robertson Phenological Model. Tech- 
nical Memorandum, LEC-597U. Lockheed Electronics Company (Houston, 
Tx.), 1975. 

< muL ULMUIV l»u. • 


U-l 



AFPEKTIX A 


HISELTS Of 1975 TRACKING OF CROP CALENDAR? 

Th. result, or t.,e 1975 tracking of crop eslendar. 
given In figure. A-l and A-0 and In table *-!. 
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TABLE A-I.- 


SUMMARY CP 1975 CCMP ARISONS (SRS 


REPORTED MINUS PREDICTED ^ POR ALL STAGES 


Crop reporting 
district 

Mean difference 
(bias), days 

Standard deviation, 
days 

OK5 (winter) 

1.50 

1.32 

KS5 (winter) 

1.50 

3.26 

N35 (winter) 

U.1T 

3.1*0 

NB* 5 (spring) 

2.33 

u.ou 

SD5 (winter) 

1.67 

2.52 

SD* v spring) 

1.17 

1.26 

A] ! grates 

0.33 

3.33 
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Kansas CRD 05 1974 to 75 winter wheat 

Figure A-l.- Results of the 1975 tracking of crop calendar 

for Kansas CRD 05. 
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Oklahcnw CRD 55, 1974 to 75 winter when' 

Figure A-2.- Results of th* 1975 truck! lg of caUnd*r 

for Oklahoma CRD 55* 
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L bL AUK WUlAPitelX B 

r’MUt 

TESTS FOR STATISTICAL ASSUMPTIONS 
Homogeneity of Variance 

A. F-test for comparing mean squares for two treatments. 

3. 3artlett's test for comparing more than two mean 
squares . 

C. Plot residuals versus the expected values as predicted 
by the model. 

D. Plot residuals against the independent variables. 

n 

E. Calculation of the statistics Tg. a e“ Y. as giver, 
in Draper and Smith [1966]. 

Non-correlations Among the Residuals 

A. "When the ratio (n - p)/n equals (number of degrees of 
freedom in residuals )/(nunfcer of residuals) is quite 
small" the effect of correlation among residuals must 
be considered. 

3. The correlations can be computed by the formule 

covar(e, ,e,) 

p s — . . . : . U ' 

1J V t C*> t Cj) 

"Values of these correlations thus depend entirely on 

2 

the elements of the matrix X, since a cancels." 
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Additivity of Terms in the Model 


A. Plot residuals versus expected values as predicted by 
the sodel. 

3. Plot ~eslduals versus independent variables. 

n 

C. Computation of the statistic 7, , ■ ^ e, Y‘ as given 
in Traper and Smith [i 960 ]. 

Normality 

A. Histogram the residuals. 

3. Kolmogorov - smirnov goodness of fit test. 

C. Chi-square goodness of fit test. 

D. Complete the third moment about the near, -o *est for 

skewness . 

E. Compute the fourth moment about the mean to test for 
kurtosis. 
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